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We propose a definition for tiie Polya number of continuous-time quantum walks to characterize 
their recurrence properties. The definition involves a series of measurements on the system, each 
carried out on a different member from an ensemble in order to minimize the disturbance caused by 
it. We examine various graphs, including the ring, the line, higher dimensional integer lattices and 
a number of other graphs and calculate their Polya number. For the timing of the measurements 
a Poisson process as well as regular timing are discussed. We find that the speed of decay for the 
probability at the origin is the key for recurrence. 
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I. INTRODUCTION 

Random walks are an important part of physics and 
statistical sciences |lj. At the begining of the past cen- 
tury, George Polya considered the question, what is the 
probability that a walker ever returns to the starting 
point 0. This probability is called the Polya number. 
He found that in a one or two dimensional integer lat- 
tice the Polya number is one, i. e. the walker returns to 
the starting point with certainty, the walk is recurrent. 
In higher dimensions, there is a finite probability that 
the walker never returns to the origin, in this case the 
walk is transient. Polya's recurrence theorem is impor- 
tant in classical physics, for example in reaction-diffusion 
systems Q- 

The concept of the quantum walk was introduced by 
Aharonov, Davidovich and Zagury [3]. The unitary time 
evolution of the quantum random walk has two main 
types: the discrete time evolution 5], when an extra coin 
degree of freedom is introduced and an associated coin 
operator assists in the evolution of the system at discrete 
time intervals, and the continuous-time case when the 
walker can change its position at any time. Classically, 
there is a straightforward embedding which relates the 
two types of walks to each other [l|. The situation for 
the quantum walks is different, because the Hilbert space 
of discrete time quantum random walk contains an extra 
coin space Q- 

Continuous-time quantum walks have recently been at- 
tracting interest, because theyprovide a tool to design 
efhcient quantum algorithms [8|. In general, quantum 
walk can be regarded as a universal computational prim- 
itive, with any quantum computation encoded in some 
graph On the other hand, the physical relevance of 
continuous-time quantum walk stems from its relation to 
transport processes [lO*!. 

Spreading of quantum walks is faster in general com- 
pared to the classical equivalent due to its wave nature 
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|11| . however interference can significantly modify this 
picture [l2j . The spreading properties of a quantum walk 
are related to the probability of staying at the localized 
starting position [l3|, indicating, for example, the non- 
classical university class for a continuous-time quantum 
walk on a line with long-range steps JJij. The time de- 
pendent probability at a position is related to observation 
of the system if one additionally defines a measurement 
process. Our aim in this paper is to suggest such a pro- 
cess and define Polya number for this case and discuss 
how it is related to the asymptotic evolution. 

Recurrence properties of the discrete time quantum 
walk can be characterized by the generalized Polya 
number [T5l.lT6|. In contrast to the classical case, the walk 
can be transient in two dimensions as well as recurrent in 
arbitrary higher dimensions, depending on the coin oper- 
ator and the initial state. The definition does not trans- 
late directly to the continuous-time case since it contains 
measurements and, unlike in the discrete time case, there 
is no natural timing for detection. Varbanov, Krovi and 
Brun encountered a similar problem in the definition of 
the hitting time for the continuous-time quantum walk 
p7| . They suggested to use a Poisson process for the tim- 
ing, with A measurement rate. It means that in a small 
St period we measure in the system with s probability, 
and let the system evolve unitarity with 1 — e probability. 

In thispaper, we extend our definition of the Polya 
number |15l . |l6| to continuous-time quantum walks. The 
observation of recurrence includes measurements at dif- 
ferent time instants, which unavoidably disturb unitary 
time evolution. Following our definition for discrete-time 
quantum walks, we suggest to measure each system in an 
ensemble only once, after different periods of time evo- 
lution. We discuss both random (Poisson process) and 
periodical measurements. 

In section |TT1 we give a definition for the Polya num- 
ber, and in section Hill we use our definition with Pois- 
sonian sampling for the periodical chain, and for the d- 
dimensional integer lattices. In section HVl we compare 
our results with periodical measurement for the systems 
that were considered in section lllll In section |Vl we ap- 
ply our methods that were used in section Hill for other 



2 



graphs with known time evolution to determin its Polya 
number. 



II. DEFINITION OF THE POLYA NUMBER 

The continuous-time quantum walk was defined by 
Farhi and Gutmann Q. We have a G{V,E) undirected 
graph, and let us denote the vertices with a = . . . N —1. 
Then corresponding to the graph we construct an A^- 
dimensional Hilbert space with an orthogonal {|a)} ba- 
sis, where a = ... — 1 and {a\b) = Sab- The unitary 
time evolution is 



Uit) 



-iHt 



(1) 



where the matrix elements of the Hamiltonian are 



{—7, if \a) and \b) are neighbouring states, 
0, if I a) and |6) not neighbouring, 
fc7, if|a) = |6), 

(2) 

and k is the degree of the vertex, and 7 is a time- 
independent constant. For simplicity, we can choose 
7 = 1, it only rescales time. The wave function of the 
system after time t is 



(3) 



and the walk starts from the |5'(0)) = |0) state. We 
would like to calculate the probability that the walker 
ever returns to the starting point of the walk, i. e., the 
Polya number. When defining such a quantity, we have 
to consider measurements on the system. At this point 
one has to deal with two problems. First, a measurement 
on a quantum system means an unavoidable disturbance, 
leading generally to a non unitary evolution. Second, the 
time evolution is continuous unlike for the discrete-time 
quantum walks, thus the natural procedure for discrete- 
time walks, to make a measurement in each time-step 
cannot be applied here. The problem of the disturbance 
caused by a measurement can be avoided if we adopt the 
following procedure [l5l.[l6|: each measurement is carried 
out on a different member from an ensemble of identically 
prepared and identically evolving systems, after a differ- 
ent time of the evolution. For the seco nd p roblem of 
timing the measurements Varbanov et al [T3| suggested 
the use of a Poisson process with rate A when defining the 
hitting time of continuous-time quantum walk. We will 
compare the random timing and the regular time steps 
for the measurement. 

Let us define the Polya-number in the following way. 
We measure the position of the walker with a series of von 
Neumann measurements. Every measurement is made on 
a new system from an ensemble containing identical sys- 
tems that were evolved in the same way. The probability 
that we measure the walker at the origin reads 



Po(t) = |(0|e 



-iHt\ 



(4) 



for each system in the ensemble. The events correspond- 
ing to the measurements are independent, therefore the 
probability that the walker was not found at the origin 
until time i„ can be expressed as 



(5) 



The Polya-number can then be defined as the probability 
of the complementary event, by taking the limit f — > 00 



(6) 



It can be shown that the infinite product in the second 
term is zero, iff the following sum is divergent 



(7) 



and then the Polya number is 1 and the walker returns 
to the origin with certainty, otherwise there is a finite 
probability of escaping. 

The above definition provides a fixed value for the 
Polya number for a given sequence of time instants 
{ti,t2,t'i, where ti < t2 < H < For example, 

this is the case for measurements following each other 
regularly with t^+i — ti = T. We will consider such peri- 
odical measurements in Section ITVl 

When the timing of the measurements is chosen ran- 
domly, we can describe it with a continuous-time count- 
ing process and the Polya number becomes a random 
variable with respect to the realizations of the process. 
The probability space P) together with the count- 

ing process {X(t)|t € R} defines the time instants when 
a measurement occurs: {^i, ^2, ^3, ■•■} = a; G are the 
elements of the event space. Thus, the Polya number 
should be considered as a random variable. Its expecta- 
tion value can be expressed as 

/■OO 

E\P] = 1 - lim / dTi... dTN 



N 



/(ri,T2,...rjv)n 



n=l 



(8) 



where /(Ti, . . . Tjv) is the joint probability of having 
the first jump in the counting process at ti = Ti, the 
second at ^2 — Ti -\-T2, and so on. The counting process 
is a renewal process if the inter-measurement times Ti 
are independent, identically distributed variables. In this 
case the expectation value of the Polya number reads 

/■OO 

E\P] = 1 - lim / dTi... dTN 

N^ooJo 



N 



N 



n=l 



1-pAY.t, 



(9) 
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III. EXAMPLES WITH POISSONIAN 
MEASUREMENTS 



We apply our definition to calculate the Polya number 
for various examples. In this section we will use a Poisson 
process for sampling the times for the measurements. It 
means that the {ti}^i measurement-time sequence con- 
tains random variables having the property that the in- 
terarrival times Ti — ti,T2 — t2 — ti,T^ = — t2, ■ ■ ■ are 
independent random variables, each with /(Ti) — Ae^^^' 
distribution, according to the definition of the one dimen- 
sional Poisson process with intensity A [1^ . In this case 
the expected value of the Polya number reads 



/•oo 

E\P] = 1 - lim A^ / dTi... dTN 



N 



N 



exp 5]-AtJ n 

\fc=l / n=l 



(10) 



This expression is too diflicult to calculate exactly, in 
our calculations we will use other methods to evaluate 
the Polya-number. 



Periodical chain 



Let us consider a periodical chain that contains N 
quantum states. We have to find the probability at the 
origin Q, which is the square of the (1,1) element of the 
g-iHt jjia^^j-jx. It can be calculated easily if we recognize 
that the Hamiltonian is a symmetric cyclic matrix 



C(co, ci, . . . , cjv-i) = 



/ Co Ci C2 

CjV-1 Co Ci 
CjV-2 Cat^I Co 



V Ci 



C2 C3 



CN-1 \ 
CN-2 
CN-3 



Co 



(11) 



A general matrix element of a matrix function ofsym- 
metric cyclic matrices can be explicitly expressed [2l| . If 
the matrix is in the odd class ( = 2n + 1 is odd) , then 



{/(C)}, 



2n 



^/(^co + 2^^c.j 



2n 



cos ■ 



fe=l 



2n + l 



cos ■ 



2ukTr \ {p — q)2kn 
2n + l 
(12) 



and if = 2n is even, then 



Cn-l 
co + (-l)"c„ + 2^(-l)'^c, 

-E/ho+(-i)^c„+25: 



fe=i 



■r-^ vkn] (p — q)kiT 

cos cos . 

n j n 

(13) 



From the definition of the Hamiltonian ^ the matrix 
elements for the periodical chain are except for cq — 
—2i"ft and ci = cat-i = ijt. Therefore, the probability 
that the walker is at the origin for odd A reads 



Po{t) = 



1 



(2n+l)2 (2n-|-l) 



— J2 cos(27iaj) 



where 



2fc7r 2j'7r 

£,ki = cos — cos - 

^ ^ 2n+l 2n + l 



(14) 



(15) 



and for even A^: 



n n—1 



^"^^^ ^ 2;^ + 2;^ + E E ^osi2jta,) 



where 



kiT 



COS ■ 



j=0 k=l 



JTT 



(16) 



(17) 



In order to find the Polya number, we are interested in 
the limit of the sum ([7]). There exist time series for the 
measurement such that the sum is convergent. However, 
we will show that the probability of this event is zero. We 
could express the function po {t) as a finite sum of cosine 
functions. Thus the extrema of this analytic function 
cannot have an accumulation point other than infinity. 
On the other hand, it cannot tend to zero. Let us choose 
a small positive constant e (0 < e < 1). We can estimate 
the sum by taking only values greater than e 



'^Po{tt)> E Po(*' 



(18) 



i=l 



PQ{U)>e 



We are going to prove that the probability of having only 
a finite number of points greater than e is zero. Let 
us denote the position of the ith minimum with Ui and 
introduce 5i, the size of the interval around rii where 
p{t) < £. Let the test period be t = mjv and suppose that 
M samples are taken from the function. We find that the 
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probability of j sample from the M being greater than e 
reads 



Pij) = 



M-j 



t 



EJV-i r 



(19) 



The second and the third factors can be rewritten as 



Pooij) 



lim 

M,t^oo \ J 



0, 



(20) 



where 77 < 1 (for a small enough s it cannot be 1, even in 
the limit of t — >■ 00, because po{t) is an almost periodic 
function) and fi < 1 and does not depend on M. We 
find that there are infinitely many points where Po(t) is 
greater than e, therefore the sum 



1=1 



(21) 



is divergent. Thus we have proved that the walk on a 
periodical chain is recurrent, its Polya number is one. In 
the proof we did not use the A parameter, consequently 
the Polya number is independent of the parameter of the 
Poisson process. 

This proof can be applied for any finite graph. The 
probability that we measure the walker at the origin for a 
finite system that contains N quantum states can written 
as a finite sum of cosine functions. This probability reads 



Poit) = 



N-l 

E( 

Tl = 



-iE„t 



9n)('?ri|0) 



(22) 



where En are the eigenvalues and \qn) are the orthonor- 
malized eigenvectors of the Hamiltonian. From this for- 
mula we get 



N-l 



PO 



COS [{E-m — En)t] , (23) 



n.m—0 
|2 



where Q„ = \{0\q„)\ are reals and independent of t. 
Therefore for any finite system the Polya number equals 
one. 



B. One dimensional integer lattice 

To calculate the Polya number of the one dimensional 
lattice we need the probability of measuring the walker 
at the origin 



Po(^) = |(0|e-«*|0)|^ 



(24) 



if we start the walker from the |0) state. The matrix 
elements of the evolution operator [g read 



(25) 



thus the probability at the origin is a Bessel function 

Po{t) = J^{2t). (26) 
We have to examine the convergence of the 



i=l 



(27) 



sum if we have a given {ti}^^ measurement-time se- 
quence. We can utilize the asymptotic form of the Bessel 
function 



[Y / TOVr TT 



(28) 



Since a finite number of terms does not change the con- 
vergence of a series, for the evaluation of the Polya num- 
ber we have to consider the asymptotic convergence 



^ cos^ {2U ~ f ) 



1=1 



(29) 



In the Appendix, we prove that the sum ^2 with Pois- 
sonian sampling is divergent with probability 1. Conse- 
quently, the sum 



S = ^poiU) 



(30) 



is divergent with probability 1, therefore the continuous- 
time quantum walk on the line is recurrent, its Polya 
number equals 1. 



C. Higher dimensional integer lattices 

In this section we consider the Polya number for a d- 
dimensional integer lattice. The probability factorizes 
to d-independent one-dimensional probabilities [isl . [l9| , 
thus the probability that we measure the walker at the 
origin reads 



Po 



(31) 



From the asymptotic form of the Bessel functions 
the envelope of po{t) is We would like to determine 
the convergence of the sum 



(32) 



If the above sum is convergent the walk is transient. We 
can estimate the sum by 



00 



(33) 
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where g{t) is the number of measurement points in the 
[t — 1; t] intervals, where t G IN . Now, consider the prob- 
abihty that in each interval there are less measurement 
points than the corresponding t, it is the probability that 
g{t) < t. According to the definition of the Poisson dis- 
tribution, the probability that there are less than t mea- 
surement points in any unit interval reads 

P{g{t)<t)=Y,^e-\ (34) 

From this, the probability that our condition is fulfilled 
reads 

p{g{t)<t\yt) = n E^^^M 

t=i \ k=t / 

The above infinite product tends to if and only if the 
following double sum is divergent (see (T6|): 

oo oo .jr. 

EE^^-^--- (36) 

t=o k=t 

Since the summand of the first sum is decreasing faster 
than any power 

°° \fc °o \fe \t 

k=t k=t+l 

thus the ([55]) sum is convergent. Consequently, 

P{g{t) <t\yt) >0, (38) 

i. e. the probability that in each interval there are less 
measurement points than t is not 0. Thus, there is a 
nonzero probability that g{t) < t and therefore with the 
same probability the sum S can be estimated as 

oo 

'5<E^(^' (39) 

which is convergent for d > 3. 

In summary, if the dimension of the lattice is 3 or 
greater then there is a finite probability that the walker 
never returns to the origin and thus the walk is transient. 
A similar line of thought can be applied for dimension 2 
and prove with a somewhat more lengthy but straightfor- 
ward calculation that P{g{t) < y/t) > for the number of 
the measurement points in each interval. In this way one 
can prove the transience of the walk also for dimension 
2. 

One can estimate the expectation value of the Polya 
number from (|10p using the first few factors from the 
product. Table HI lists the approximate value of the 
Polya number for dimensions 2,3 and 4 by using the first 
three factors. In order to estimate the error we list the 
difference compared to the next order approximation. 



d E[P3] E[P4]-E[P3] 

2 0.354 0.002 

3 0.2968 0.0003 

4 0.26374 0.00007 



TABLE L The expectation value of the Polya number for a 
regular integer lattice in 2, 3 and 4 dimensions with Poisso- 
nian timing of the measurements (A — 1). We have included 
three measurement points to estimate the expression (|10|) . 
The contribution from the fourth measurement point is also 
evaluated, indicating the error of the estimation. 



IV. EXAMPLES WITH PERIODICAL 
MEASUREMENTS 

In this section we consider the case of measuring reg- 
ularly, in T time intervals in the same systems that we 
considered in the previous chapter. 



A. Periodical chain 

For the periodical chain the probability is a finite sum 
of cosine functions, so it can be periodic or a non-periodic 
function, depending on the ratio of the coefficients in 
the arguments. If it is non-periodic, then with periodic 
measurements there will be an infinite number of points 
that are greater than a small constant, therefore the ([7]) 
sum is divergent. If po{t) is periodic and its minimum is 
zero (that is the case for example for a chain of length 
4), and we measure with the same periodicity and timing 
of the first measurement, then the ^ Polya- number is 
exactly 0. On the other hand, let us suppose that the 
timing of the measurements has some error. In this case 
the sum will become divergent and the Polya number is 
1. 



B. Integer lattices 

The probability that we measure the walker at the ori- 
gin for the one-dimensional lattice is po{t) = J^{2t). One 
can see from the (|28l) asymptotic form of the Bessel func- 
tion that it is possible to asymptotically coincide with the 
zeros of the probability distribution if one measures with 
the right period. In this case the Q sum is convergent 
and the walk is transient, in contrast to the walk with 
Poissonian sampling, which is recurrent. If we allow for 
some small deviation 5 in the timing of measurement, 
then we again find that the walk is recurrent with prob- 
ability 1. The error of the measurement timing means 
that we take measurement points from [nT — 5] nT + S] 
intervals, where T is the period of the measurement. The 
cosine function in the asymptotic form of the Bessel func- 
tion is symmetric around the minimum point, therefore 
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for the convergence of the 

oo 

5-^j2(2iO (40) 

1=1 

sum we have to consider the convergence of the 



> 



E 



^-^ riT + (5 ^ riT 

n=l n:r<e„ 



(41) 



sum, where < £„ < is a random variable, and 
cos2[2(nr + (5) - f ] = es- For a given < T < es 
constant the 



E 

n=l 



nT + S 



E 

n:r<e„ 



E 

n:r>e„ 



nT + 6 



(42) 



sum is divergent. If we choose F such that the probabihty 
of e„ being greater than F is 0.5, then both sums on 
the right side in (|42|) are divergent and therefore (|4ip is 
divergent with probability one. Thus the walk becomes 
recurrent for the one-dimensional lattice if we allow any 
small error in the timing of the measurements. 

For the higher dimensional integer lattices the Polya 
number is less than one with the periodic measurement 
procedure, because the decay of the envelope of the po{t) 
function is faster than t^^. The actual value depends 
sensitively also on the timing of the first measurement. 



V. OTHER GRAPHS 

In this section we show how we can apply our results 
and methods for systems where the asymptotic evolution 
of the probability at the origin is known. 

For finite systems the po{t) probability cannot tend to 
zero as explained in section IIII Al A number of finite 
graphs have been discussed in the literature, for example 
the finite star graph [5^, the complete graph, the cycle 
graph [i^l, etc. The Polya number is one for all these 
finite graphs. 

For an infinite graph, we have to consider the decay 
of the po{t) probability. One can follow a similar anal- 
ysis as in sections IIII Bl and IIII CI It po{t) has asymp- 
totically the form f{t) ■ t^" with a < 1 where f{t) is a 
periodic or almost periodic analytical function, then with 
Poissonian sampling the walk is recurrent. If the enve- 
lope decays faster (a > 1), then the walk is transient. 
For example, the Polya-number of the honeycomb lattice 
is smaller than one, because for this graph a = 2 [2^ . 
In a spidernet graph [2^ a = 3, therefore the walk is 
transient. Finally, the probability that we measure the 
walker at the origin for an infinite Hermite graph is an 
exponential function (23j . therefore it converges to zero 
faster than any power, thus the walk is transient. 



VI. CONCLUSIONS 

The present definition for the Polya number of the 
continuous-time quantum walk is applicable for an ar- 
bitrary time-sequence of measurements. The measure- 
ments can be timed according to a stochastic process, 
with random waiting times. As a consequence, the Polya 
number, which is itself a probability due to the random 
nature of the measurement results on a quantum sys- 
tem, will become itself a random variable according to 
the probability space of the measurement time sequences. 
We find that for some graphs one can determine its value 
with probability unity. In the general case it is a random 
variable depending on the timing of the measurements, 
thus one can use its expectation value. 

We have focused on the recurrence properties of the 
walk for the periodical chain and d-dimensional integer 
lattices using our definition with Poissonian sampling. 
The Polya number is determined by the decay of the 
probability that we measure the walker at the origin, 
similarly to the discrete-time quantum walk. For the 
periodical chain and the one-dimensional regular lattice 
the Polya number equals one, like for the classical as well 
as the discrete-time quantum walks. For higher dimen- 
sional integer lattices it is smaller than one, in contrast 
to the classical walk. Our proof for the periodical chain 
can be applied for any finite graph. 

We have also discussed what happens if one measures 
periodically instead of the random Poissonian sampling. 
In this case a transient walk can be observed in systems 
where the Polya number with Poissonian sampling would 
be one. The apparent paradox is eliminated if the timing 
for the measurement is not ideal, then the Polya num- 
ber is the same with Poissonian and periodically sam- 
pling. When the decay of the probability at the origin is 
known for a given graph, the recurrence of the walk can 
be directly decided applying our definition. For transient 
walks the first few measurement points usually provides 
a good estimation for the Polya number. 
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Appendix 

In the Appendix we prove that 

oo 

S = Y,Po{U) (43) 

1=1 

where po{t) = Jq (2<), is divergent with probability 1 for 
Poissonian sampling. The asymptotic form of the Bessel 
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function reads 



Therefore, in the k ^ oo case we find that 



Jo(x) 



cos 



(44) 



thus the envelope of Poit) is j. 
First we consider the 



oo 



(45) 



sum. We can use the fohowing convergence criterion: let 
us suppose that the 



lim - — = a 



(46) 



limit exists, where < ti < oo. Then '^k is conver- 

gent if and only if J2'kLi convergent. We can choose 

1 , 1 , Qk k 
ak = — , Ok = Y , then — = — . (47) 
tk k bk Ik 

The probability density function for the time of the fcth 
measurement in the Poisson process reads 



k-l 



(fc-1)! 



(48) 



We know from the central limit theorem that this distri- 
bution converges to the normal distribution as fc — > cxd: 



A 



exp 



2k 



(49) 



1-^U<^<(1 



In(fc) J \ - k 



In(fc) J A ' 



(55) 



with probability unity and if we take the limit on both 
sides 



lim ^ = i 

fc-foo k A 



(56) 



From this result cr = A in the convergence criterion. We 
know that I divergent, thus 



Si 



^ t 



(57) 



is divergent with probability 1. 

For our final result we have to consider the convergence 

of 



^2 



(58) 



We know that 



J2 cos^ {2U - f ) ^ ^ £ _ ^ 



(59) 



where < e < 1 is a small constant, and we introduced 



From this distribution we can calculate the probability, 
that fcth measurement point, tk G [A, B] : 



P 



/W(t)di 



(50) 



2 V \ V2k J \ V2k 



where 



erf(x) = ^ / e-*'di. (51) 
Jo 

We will see later that a good choice for the integration 
limits is 



^= 1- 



1 



In(fc) J A 



^, B= 1 



1 



k 



In(fc) J A 



With this 



P = erff ] 
I V21n(fc) i 



(52) 



(53) 



The limit of this probability from the definition of erf(a;) 
reads 



lim P = 1 , 



(54) 



P = {ieTN : cos^(2t, --)>£}, 
Q = {ieK : cos2(2t, - ^) < e} . 



(60) 



The following sum, which is divergent with probability 
unity, can be divided according to P and Q 



(61) 



Consider the case if e = 0.5. Then the length of the T 
period of the cosine function is divided into two equal 
parts with size ^ and falls with equal probability in 
P or Q. For large i index, the ith element of the sum 
V will be near to the 2ith element of the original sum. 
Therefore from (l56l) 



(62) 



tl ^ tk 2 

lim = 2 lim — = — 

fe— »oo k k—^oo k A 



and we can apply the convergence criterion for V. It is 
divergent, therefore from ((59|) ^2 is also divergent with 
probability unity. The convergence of the S sum depends 
on the asymptotic behavior of the Bessel function. Since 
^2 is divergent, S will be divergent as well. 
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